Copy  28  ***  copies 


AD-A260  971 

lillllllli 


IDA  DOCUMENT  D- 1 066 


FIDELITY  AND  VALIDITY  IN  DISTRIBUTED  INTERACTIVE  SIMULATION: 

QUESTIONS  AND  ANSWERS 


Norman  E.  Lane 
Earl  A.  Alluisi 


93-03939 

ninini 


Prepared  for 

Defense  Advanced  Research  Projects  Agency 


IDA  Log  No.  HQ  91-40476 


DEFINITIONS 

IDA  publMies  Dm  following  docomonti  to  rogort  the  rowHt  of  it*  woik. 


Reports 

Reports  aro  ttw  most  authoritatiM  and  niott  earafttlly  contidnrod  products  IDA  publislios. 
They  normally  embody  results  of  ma|or  projacts  which  (a)  have  a  direct  bearing  on 
dacisions  aflncting  major  programs,  (b)  address  issuos  of  significant  concam  to  tho 
Esoeutise  Branch,  tho  Congress  and/or  the  public,  or  (c)  address  issues  that  hauo 
signiticant  aconomic  implications.  IDA  Reports  an  raviownd  by  outside  panels  of  oiports 
to  ensun  their  high  quaiity  and  niavanca  to  tho  problems  studiad.  and  they  an  nleased 
by  the  President  of  IDA. 

Group  Reports 

Gnup  Reports  ncard  tho  findings  and  nsults  of  lOA  astablished  wothing  gnups  and 
panels  composed  el  senior  indhtidnals  addressing  major  issues  which  otberwiso  would  be 
the  subject  of  an  IDA  Report.  lOA  Gnup  Reports  an  roeiewed  by  lb*  senior  individuals 
nsponsibi*  fnr  the  pmjact  and  othen  as  selected  by  lOA  to  ensun  Iheir  high  quality  and 
nlevance  to  the  problems  studied,  and  an  nleased  by  the  President  of  IDA. 


Papers 

Papen,  also  authorltativ*  and  carefully  considered  products  ot  IDA,  address  studies  that 
an  narrower  in  scope  than  those  covered  in  Reports.  IDA  Papen  an  nviawed  to  ensun 
that  they  moot  the  high  standard*  aspectod  of  nfemd  papen  in  pnfessional  journals  or 
formal  Agency  nports. 


Documents 

IDA  Documents  an  used  for  the  convonianca  of  the  sponson  or  tho  analysis  (a)  to  ncord 
substantive  work  don*  in  quick  naction  studies,  (b)  to  record  the  proceedings  of 
contennees  and  meetings,  (c)  to  make  available  pnllmbiaiy  and  tentative  nsults  ot 
analyses,  (d)  to  ncord  data  developed  in  the  coorse  of  an  investigation,  or  (e)  to  forward 
information  that  is  assantially  unanalyiad  and  enevaluated.  The  nview  of  IDA  Documents 
is  suited  to  their  content  and  Intended  use. 


The  work  reported  in  this  document  was  conducted  under  contnet  MDA  903  M  C  0003  lor 
the  Department  of  Defense.  The  publication  of  this  IDA  document  doe*  not  indicate 
endonement  by  the  Department  of  Defense,  nor  should  the  contents  be  construed  as 
reflecting  the  official  position  ot  that  Agency. 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  0704-01 8S 

PuMc  Rtponne  burd«n  lor  ttu*  cflUacIran  eT  inlonnafean  w  Mlmalvd  ID  avtrag*  1  hour  par  raaponaa,  lodu^g  tia  ama  lor  raviauang  maaucaona.  aaarehing  aaiaung  Oau  aourooa.  gaaianng  anO  mainuirtarg  ma  data  naodad.  and 
Oddiplatng  and  raaiauang  »w  ealaoaon  ol  inldima«on  Sand  cnnunania  ragardng  dUa  burdan  aaamaM  or  any  odiar  aapaol  oi  tiia  ccdaeton  ol  inldmtaion.  indudng  auggaaaona  lor  raduoaig  dua  burdan.  lo  Waanaigion 
Haadvianara  Sarvioaa.  IVaolvala  lor  diioimaaon  Oparaliana  wd  Rapona.  t21S  JaHaraon  Davia  Higlwiay.  SuU  1204.  Arlingun.  VA  22202-4302.  and  lo  dia  OHica  ol  Uanagamant  and  Budgal.  Paparwork  Raducaon  Proiaci 

1.  AGENCY  USE  ONLY  (L0av0  blank)  2.  REPORT  DATE 

November  1 992 

3.  REPORT  TYPE  AND  DATES  COVERED 

Final-November  1991 -November  1992 

4.  TITLE  AND  SUBTITLE 

Fidelity  and  Validity  in  Distributed  Interactive  Simulation;  Questions 
and  Answers 

5.  FUNDING  NUMBERS 

C  -  MDA  903  89  C  0003 

T-  A-132 

6.  AUTHOR(S) 

Norman  E.  Lane,  Earl  A.  Alluisi 

7.  PERFORMING  ORGANIZATION  NAME(S)  ANO  ADDRESS(ES) 

Institute  for  Defense  Analyses 

1801  N.  Beauregard  St. 

Alexandria.  VA  22311-1772 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

IDA  Document  D-1066 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  ANO  ADORESS(ES) 

Defense  Advanced  Research  Projects  Agency 

3701  N.  Fairfax  Drive 

Arlington,  VA  22203-1714 

10.  SPONSORING/MONITORING 

AGENCY  REPORT  NUMBER 

11.  SUPPLEMENTARY  NOTES 

12b.  DISTRIBUTION/ a VAILABILOTY  STATEMENT 

Approved  for  public  release:  distribution  unlimited. 

12bb  DISTRIBUTION  CODE 

13.  ABSTRACT  rMBX/mum  200 

Distributed  Interactive  Simulation  (DIS)  involves  the  on-line  networking  of  large  numbers  of  participants  operating  through 
simulators,  actual  equipment,  or  computer  models  of  friendly  and  opposing  forces  in  free-play  exercises  on  a  simulated 
battlefield.  DIS  employs  new  simulation-related  technologies  that  can  be  used  to  support  innovative  applications  generally 
not  feasible  with  the  older  technologies  of  conventional  simulation,  it  has  the  potential  of  revolutionizing  future  work  in  (a) 
collective  training  (b)  the  development  and  evaluation  of  tactical  concepts  and  doctrine,  (c)  system  test  and  evaluation,  and 
(d)  weapon  system  concept  analysis.  Its  potential  importance  is  sufficiently  great  to  suggest  that  special  attention  be  given 
to  issues  regarding  the  desirability  or  necessity  of  relevant  simulator  characteristics.  Two  such  issues  are  addressed  in  this 
document.  Specifically,  in  this  document,  simulator  fidelity  and  validity  issues  and  applications-based  fidelity  requirements 
are  addressed  in  a  question-and-answer  dialogue  format.  Secondly,  four  key  drivers  of  fidelity  requirements  are  identified; 
(a)  the  mission  to  be  simulated,  (b)  the  objective(s)  of  the  simulation;  (c)  the  fidelity  dimensions,  and  (d)  the  simulation 
components.  Thirdly,  some  conclusions  about  DIS  and  the  associated  fidelity  issues  are  discussed.  It  is  suggested  that 
two  parallel  trends-the  emergence  of  affordable  technology  and  the  continuing  'drawdowns*  in  military  resources-will 
interact  to  increase  the  importance  of  DIS  as  a  problem-solving  toot  across  a  wide  variety  of  potential  application  areas.  It 
is  suggested  that  the  advantages  and  disadvantages  of  such  DIS  applications  should  be  examined  carefully  and  logically 
for  they  are  capable  of  providing  a  powerful  supplement  or  alternative  to  large-scale  field  exercises. 

14.  SUBJECT  TERMS 

distributed  interactive  simulation,  simulation,  training,  test  and  evaluation, 
simulator  fidelity,  simulator  validity 

15.  NUMBER  OF  PAGES 

37 

16.  PRICE  CODE 

17.  SECURmY  CLASSIFICATION 
OF  REPORT 

UNCLASSIFIED 

18.  SECURITY  CLASSriCATION 
OF  THIS  PAGE 

UNCLASSIFIED 

19.  SECURmr  CLASSIFICATION 
OF  ABSTRACT 

UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRACT 

SAR 

Standard  Form  29B  (Rav.  2-69) 

Pwtcndtd  bf  MSt  fM.  23^11 
m-iM 


NSN  7540-01-280-5500 


IDA  DOCUMENT  D-1066 


FIDELITY  AND  VALIDITY  IN  DISTRIBUTED  INTERACTIVE  SIMULATION: 

QUESTIONS  AND  ANSWERS 


Norman  E.  Lane 
Earl  A.  Alluisi 


November  1992 


DTIC  QUALITY  INSPECTED  8 


INSTITUTE  FOR  DEFENSE  ANALYSES 

Contract  MDA  903  89  C  0003 
DARPA  Assignment  A- 132 


ACKNOWLEDGMENTS 


The  authors  acknowledge  with  thanks  the  helpful  comments,  suggestions  and 
contributions  of  many  persons  who  helped  in  the  development  and  presentation  of  the 
concq>ts  contained  in  this  document  Ms.  Lee  Ann  Miller  provided  outstanding  stqiport  in 
prqraratkm  of  the  manuscript  Commander  Dennis  McBride  furnished  bodi  encouragement 
and  penetrating  (but  constructive)  criticism  throughout  Drs.  J.  Dexter  Fletcher,  Jesse 
Orlansky,  Joel  Schoen,  and  Henry  L.  Taylor  each  made  recommendaticMis  for  the 
improvement  of  earlier  versions,  and  most,  but  not  all,  of  their  advice  has  been 
incorporated  into  this  final  edition.  However,  since  they  made  all  final  deciskxts  regarding 
the  paper,  die  authors  must  claim  sole  responsibility  for  all  errors  and  faults  diat  remain. 


•• 


n 


ABSTRACT 


Distributed  Interactive  Simulatitm  (DIS)  involves  the  on-line  netwoildng  of  large 
numbers  of  participants  operating  through  simulatt>rs,  actual  equipment,  tn-  computer 
nv^gls  of  firiendly  and  (^>posing  forces  in  finee-play  exercises  on  a  simulated  battlefield. 
DIS  enq)loys  new  simulatitxi-telated  technologies  that  can  be  used  to  support  iimovative 
iqrplicatimis  generally  not  feasible  with  the  older  teclmologies  of  cmventimuLl  simulation. 
It  has  the  potential  of  revolutionizing  future  work  in  (a)  collective  training,  (b)  the 
development  and  evaluation  of  tactical  concepts  and  doctrine,  (c)  system  test  and 
evaluatkm,  and  (d)  weiqxHi  system  concept  analysis.  Its  potential  inqxvtance  is  sufficiently 
great  to  suggest  that  special  attention  be  given  to  issues  regarding  the  desirability  or 
necessity  of  relevant  simulator  characteristics.  Two  such  issues  are  addressed  in  this 
document 

Specifically,  in  this  document  simulator  fidelity  and  validity  issues  and 
qjplications-based  fidelity  requirements  are  addressed  in  a  questirm-and-answer  dialogue 
fcnmat  Fust  some  basic  terminolqgy  and  definitions  are  presented.  Attention  is  focused 
on  the  unpredsion  of  the  term  fidelity  and  its  limited  utility  in  describing  complex 
simulations  (some  22  different  defiiutitms  of  fidelity  have  been  used  in  various  contexts). 
Some  alternative  ways  d  viewing  fidelity  coocqxs  are  presented. 

Secondly,  four  key  drivers  cf  fidelity  requirements  ate  identified:  (a)  the  misskm  to 
be  simolated,  (b)  the  objective(s)  of  the  simulatirm;  (c)  the  fidelity  dimensions,  and  (d)  the 
simulation  conqnxients.  Based  on  these  drivers  and  on  tiie  premise  that  each  decisicm 
about  the  configuration  of  a  simulation  nuist  be  justified  (or  **anchoted’0  by  a  defined 
simulatitm  requirement,  the  concept  of  fidelity  anchoring  is  introduced  as  a  way  of 
systematically  making  decisions  about  fidelity  requiteinents  in  DIS. 

Thirdly,  some  ccmclusitMis  about  DIS  atKl  the  associated  fidelity  issues  are 
discussed.  It  is  suggested  that  two  parallel  trends-the  emergence  of  affordable  technology 
and  the  continuing  "drawdowns"  in  nulitary  resources— wiU  interact  to  increase  the 
iriqxxtance  trfDIS  as  a  problem-solving  tool  across  a  wide  variety  of  potential  ^rplication 
areas.  It  is  suggested  that  the  advantages  and  disadvantages  of  such  DIS  q>plicati(»s 
should  be  examined  carefully  and  logically,  for  tii^  are  cqmUe  of  providing  a  powerful 
nq>|toiient  or  alternative  to  large-scale  field  exercises. 
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INTRODUCTION 


Distributed  Interactive  Simulation  (DIS)  involves  the  on-line  netwoildng  of  large 
numbers  of  participants— simulators,  actual  equipment  and  computer  models  of  friendly  and 
opposing  forces-in  free-play  exercises  on  a  simulated  battlefield.  The  simulation  is 
distributed  in  that  players  may  be  geogriq)hically  widely  sq>arated.  It  is  interactive  in  that 
what  eadi  participant  does  may  have  immediate  consequences  fcv  other  participants,  as  well 
as  for  himself. 

The  development  and  successful  implementation  of  DIS  exercises  is  supported  by 
the  emergence  of  a  host  of  new  simulation-related  technologies;  taken  together,  these 
technologies  enable  uses  of  simulatitxi  across  a  variety  of  iqrplicatiai  areas  not  feasible  witii 
conventional  simulation  approaches.  Because  these  applications  of  DIS  are  so  sharply 
contrasted  with  previous  simulation  approaches,  there  is  smnetimes  misunderstanding  or 
confusion  about  how  the  techndogy  works  and  what  it  is  intended  to  acconq)lish.  A  major 
area  of  confusion  has  to  do  with  the  nature  of  fidelity  and  the  degree  of  fidelity  or  validity 
required  in  qrplications  such  as  warfighting  training  and  weaptms  concept  analysis. 

Some  of  these  issues  are  addressed  in  this  paper  in  the  form  of  an  imaginaiy 
dialogue  between  (a)  an  informed,  mildly  skeptical  observer  with  interests,  but  no 
particular  expertise,  in  DIS,  and  (b)  an  advocate  of  simulation  as  a  problem-solving 
techtuque  who  is  especially  interested  in  DIS  technology  and  its  applications.  The 
imaginary  dialogue  outlines  scmoe  current  and  future  characteristics  of  DIS,  and  covers 
some  basic  terminology  and  definitions,  particularly  those  having  to  do  with  problems  in 
the  use  of  a  concept  of  fidelity  that  is  basically  inqnecise  and  therefore  not  a  very  useful 
teimtoeiq)k^  witihreferrace  to  simulations. 

In  additicm  to  discussimis  of  fidelity  terminology,  basic  skills  and  waifigbting  skills 
are  distinguished,  and  the  importance  of  their  differences  for  DIS  applications  is 
underscored.  Relations  betweoi  the  companion  concq)ts  of  fidelity  and  validity  are 
reviewed  as  they  apply  to  DIS  simulations.  Four  key  dimensions  or  drivers  of  fidelity 
requirements  are  identified  and  titeir  interactions  examined:  (a)  the  mission  to  be  simulated, 
(b)  obrjectivefs)  of  the  simulation,  (c)  fidelity  dimoisions  involved  in  the  simularinn,  and 
(d)  siiiiulation  comptments  to  be  represented  in  the  simulation.  Based  on  these  drivers,  a 
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systematic  method  for  making  decisions  about  fidelity  requirements  in  DIS,  called  fidelity 
anchorings  is  introduced,  and  some  of  its  advantages  are  discussed.  Several  possible 
classes  of  applications  are  suggested  to  illustrate  the  tnt>ad  potentials  of  DIS,  and  the 
differing  fidelity  requirements  of  each  class  are  analyzed.  The  paper  concludes  with  the 
contention  that  DIS  will  increase  in  importance  as  a  problem-solving  tool  as  "drawdowns" 
continue  in  militaiy  resources.  The  oily  alternative  to  DIS  for  certain  kinds  of  training  and 
analysis  is  the  use  of  large-scale  field  exercises,  the  conditions  of  which  are  increasingly 
more  difficult  to  meet  Thus,  while  neither  a  panacea  nor  a  threat  to  field  exercises  or 
operating  time  ("OFTEMPO"),  DIS  is  an  alternative  whose  advantages  and  disadvantages 
should  be  considered  logically  and  rationally.  At  minimum,  the  use  of  DIS  is  clearly  a 
means  of  increasing  die  effectiveness  and  efficiency  d£  whatever  OFIEMPO  is  available. 

The  imaginary  dialogue  is  in  the  form  of  17  qirestions  and  answers.  The  questions 
are: 

1 .  What  is  different  about  distributed  interactive  simulation  (DIS)  versus  more 
traditional  simulation?  Why  does  diat  matter? 

2.  What  is  meant  by,^de/try  in  simulation? 

3.  How  do  fidelity  requirements  differ  across  different  q^lications  of  DIS? 

4.  I  understand  that  fidelity  is  a  cmnplicated  term.  Is  diere  a  better  way  to  talk 
about  all  diese  different  aspects  of  fidelity? 

5.  But  don't  I  still  need  to  know  how  much  fidelity,  realism,  validity  (or 
i)i1iatever)  I  should  have  for  a  particular  simulation? 

6.  Is  it  really  possible  to  have  too  much  fidelity? 

7.  When  I  ask  about  fidelity,  pet^le  keep  telling  me,  "It  all  depends."  Why  can't 
I  get  a  strai^t  answer? 

8.  What  was  that  dboutfideUty  anchoring! 

9.  OK,  I  understand  what  fidelity  anchoring  is  intended  to  do.  How  does  cme  go 
about  (knng  that? 

10.  So  we  have  four  sets  of  dimensions.  How  do  we  use  them  to  make  fidelity 
decisions? 

11.  Fm  cmfiised  about  the  logic  of  using  the  highest  fidelity  requirement  Aren't 
we  trying  to  reduce  unnecessary  fidelity? 

12.  We've  spent  a  lot  of  time  on  fidelity  anchoring.  Why  are  you  so  ctmcemed 
about  it? 
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13.1  notice  tiiat  fidelity  anchoring  uses  relative  judgments  of  fidelity  requirements 
(high,  medium,  or  low).  Isn't  there  some  better  way  to  quantify  fidelity? 

14.  That's  enough  about  fidelity  for  now.  Let's  backtrack  a  bit  You  keep  making 
a  distincticm  between  basic  skills  and  warfighting  skills.  What’s  the  difference 
and  why  does  it  matter? 

15.  If  fidelity  requirements  are  only  dependent  on  intended  use,  why  do  people 
worry  so  much  about  negative  training! 

16.  You  mentioned  earlier  the  validity  of  a  simulation  as  another  way  of  talking 
about  fidelity.  Can  you  expand  on  that  idea? 

17.  OK,  that  just  about  wrq)s  it  up.  Any  final  comments? 

The  reference  tnatftrials  that  were  used  in  the  development  of  tlie  questions  and 
answers  are  listed  at  the  end  of  the  paper,  and  they  are  also  linked,  where  appropriate,  to 
the  separate  questi(»s. 
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QUESTIONS  AND  ANSWERS 


1 .  What  is  different  about  Distributed  Interactive  Simulation  (DIS)  versus 
more  traditional  simulation?  Why  does  that  matter? 

Distributed  Interactive  Simulation  (DIS)  involves  networking  or  linking  together,  in 
real  time,  some  number  of  manned  simulators  with  each  other,  and  sometimes  with  actual 
equipment  or  computer  models.  Each  of  these  participants— simulators,  operational 
equipment,  or  models~is  called  an  entity,  and  each  entity  uses  its  own  (and  probably 
different)  computer  system  to  put  data  oi  and  take  data  off  a  simulation  or  communicadcms 
network.  These  data  describe  in  real  time  the  changes  that  would  take  place  in  what  each 
entity  would  see,  hear,  or  otherwise  sense  if  the  simulated  battlefield  activities  wm  real. 
The  simulation  is  interactive,  so  actions  taken  by  one  entity  may  have  direct  consequences 
for  other  entities,  and  are  immediately  reflected  in  changes  to  what  other  entities  can  see, 
hear,  or  sense.  Battlefield  situatimis  are  changed  dynamically  by  entity  activities,  and 
because  of  this  fiee  play,  battle  outcomes  are  never  predeterminable,  but  rather  evolve  as  a 
direa  result  of  interactions  among  the  players  in  tiie  simulaticm. 

DIS  requires  that  the  simulations  be  interoperable.  Thus,  simulators  and  equipnoent 
at  varying  levels  of  sophistication  and  fideli^  must  be  able  to  participate  in  the  battle  on 
equal  terms,  even  if  they  are  built  with  different  coixq)uter  architectures.  There  must  be  a 
"level  playing  field."  Because  each  individual  oitity  may  use  a  different  way  of  coding  or 
representing  relevant  information,  special  attention  has  to  be  given  to  combining  these 
many  different  formats  into  a  single  standard  set  cS  ccnnmunication  protocols  by  ^dikh  data 
packets  are  passed  around  the  network.  Develqnng  and  maintaining  these  protocols  and 
other  requirements  of  interoperability  add  to  DIS  significant  elements  of  cQn:q)lexity  not 
preset  in  tiie  typically  ccmventional  simulations. 

The  simulation  is  (Ustributed,  so  entities  may  be  widely  sq)arated  geographically- 
even  worldwide.  Under  such  conditions,  successful  operations  require  careful 
considetations  of  communication  delays  to  maintain  realistic  real-time  interactions.  Current 
networics  could  involve  a  thousand  or  more  entities,  each  of  which  would  have  to  examine 
all  individual  packets  of  infonnation  on  the  network  to  determine  tiie  specific  self-rdevanoe 


of  each.  Future  DIS  networks  might  have  to  link  hundreds  of  thousands  of  entities,  and 
thereby  generate  so  many  packets  that  no  single  participant  could  examine  and  respond  in 
real  time  to  all  of  them.  Special  processors  such  as  intelligent  gateways  will  be  needed  for 
these  large  future  DISs.  Each  gateway  would  service  a  large  group  of  entities,  monitoring 
the  network  information  traffic,  sorting  out  and  fcnwrarding  what  each  entity  needs  to  know 
based  on  its  unique  requirements.  Development  and  use  of  such  intelligent  gateways  will 
enable  alnoost  imlimitftH  participation  in  battlefidd  simulatitms  by  entities  throughout  the 
world. 

Papers  for  further  reading  on  tqrics  related  to  Question  1  include  AUuisi 

(1991),  Institute  for  Simulation  and  Training  [IST)  (1990, 1991),  Repolewsld  (1990),  and 
Thorpe  (1987). 

2 .  What  is  meant  by  fidelity  in  simulation? 

People  tend  to  use  the  term  fidelity  as  a  kind  of  shorthand  for  describing  how 
closely  a  simulation  corresponds  to  the  "real  thing."  We  can  talk  about  a  reference 
situation,  in  which  the  real  system  is  petfcnming  a  speciEc  mission  under  specific 
operational  conditions.  If  we  could  define  tiie  reference  situation  precisely ,  we  could  think 
of  fidelity  conceptually  as  the  degree  of  correspondence  between  our  simulated  situation 
and  the  reference  situaticm.  Unfortunately,  there  are  just  too  noany  wa3rs  in  which  missions 
and  conditions  can  vary  for  this  sort  of  couceptual  definition  to  be  of  much  help  in 
describing  the  fidelity  of  any  particular  simulation.  In  fact,  unless  we  add  a  great  numy 
additiotud  modifiers,  the  term  fidelity  is  so  general  as  to  be  almost  meaitingless  in  asking 
simulation  questions.  For  example: 

There  is  no  single  definition  of  fidelity.  Attenqrts  to  make  the  term  less 
vague  have  cau^  di^inctions  to  proliferate;  at  lrast22  d^erent  definitions 
have  been  used  in  the  literature  to  refer  to  different  kinds  of  fidelity 
physical,  equipment,  psychological,  percqmul,  functitmal,  procedural, 
task,  bgi^c,  tlueat,  etc.).  Each  ^  th^  defimtitHis  could  be  iqjptopriate  in 
some  tq^lication. 

A  rimnlatinn  can  be  subdivided  into  as  many  as  20  d^erent  components 
(workstation,  visual  diqrlay,  controls,  data  base,  etc.).  Each  of  these 
compcments  may  have  a  d^erent  level  of  fideUty  associated  with  it, 
d^Nsaiding  (xi  the  intended  use  of  the  simulation  S3rstBm. 

Some  authorities  think  that  the  term,  fidelity,  should  aj^ly  only  to  the 
Amvfiware  (does  it  lode  like  and  opoaie  like  the  actual  equipment).  Others 
think  that  it  should  include  some  or  all  of  the  other  components  and 
representations  in  the  cooqrlete  simulaticm  system,  including  data  bases 
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(threats,  terrain),  communications  and  information  flows,  physical  and 

sensory  environments  (motion,  noise,  heai/cold),  and  so  forth. 

Simulation,  particularly  DIS,  can  be  used  for  many  different  purposes.  Althou^  it 
is  particularly  valuable  for  training  what  we  call  warfighting  skills,  as  in  the  SIMNET 
applications,  DIS  can  also  be  used  for  design,  test  and  evaluation  of  new  systems,  or  for 
looking  at  how  systems  might  best  be  used  (new  tactics,  concepts,  and  doctrine).  A 
particularly  valuable  use  is  for  weapons  concept  analysis,  in  which  warfighting  scenarios 
can  be  played  out  with  a  variety  of  potential  engineering  or  manpower  solutions  to  estimate 
the  battlefield  impact  of  implementing  a  proposed  solution.  Each  of  these  different 
purposes—warfighting  training,  test  and  evaluation,  tactics  development,  or  arudysis— 
en^hasizes  different  aspects  of  the  general  fidelity  concept,  and  therefore  suggests  a 
different  measure  (and  weighting  for  inqtortance)  oS  fidelity  and  fidelity  issues. 

Notice  that  by  defining  the  problems  associated  with  fidelity  as  a  descriptive  term 
with  limited  meatung,  we  have  created  something  of  a  problem  for  ourselves  in  future 
discussions.  There  is  as  yet  no  widely  accepted  lexictMi  of  terms  that  conveys  adequately 
the  multiple  connotations  implied  by  common  uses  of  tire  term,  fidelity.  We  do  not  wish  at 
this  point  to  propose  any  additicmal  terminology  to  further  confound  an  already  cloudy 
definitional  problem.  We  will  thus  ccmtinue,  albdt  reluctantly,  to  use  fidelity  in  its  broadest 
and  most  casual  sense,  as  a  shorthand  reference  for  the  overall  agreement  between  a 
simulation  and  some  general  conceptkm  of  operational  reality. 

Papers  suggested  for  further  reading  tm  topics  related  to  (^estion  2  include 
AGARD  (1980),  Blaiwes  and  Regan  (1986),  Cream,  Eggemeier,  and  Klein  (1985),  Hays 
(1981),  Hays  and  Singer  (1989,  Chs.  1-3),  Kinkade  and  Wheaton  (1972),  Meister  (1990), 
Miller  (1954),  Rankin,  Bolton,  Shildar,  and  Saari  (1984),  Serrq>le,  Hennessy,  Sanders, 
Ooss,  Beith,  and  McCauley  (1981),  and  Su  (1984). 

3.  How  do  fidelity  requirements  differ  across  different  applications  of 
DIS? 

We  noted  four  broad  classes  of  DIS  U8e-(a)  tystem  test  and  evaluaticm,  (b)  training 
in  warfighting  skills,  (c)  the  development  of  new  tactics  or  concepts  and  doctrine,  and 
(d)  wetqxms  concept  analysis.  Although  all  of  these  are  inqKntant  iqrplications  of  DIS,  the 
fidelity  questions  in  each  are  distinct  Because  the  intended  uses  of  simulation  are 
different  and  because  different  c(»iq)onents  are  emphasized,  the  requirements  for  fidelity 
have  to  be  ctmsidered  sqMuately  for  eadi  of  dw  classes  of  intended  use. 
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Test  and  evaluation  (T&E)  is  directed  toward  finding  out  if  the  equipment  can 
perform  "as  advertised"-that  is,  if  the  hardware  meets  its  design  objectives.  The  focus  of 
attention  is  on  the  system  hardware  and  all  its  subsystem-hardware  conqmnents  as  they 
interact  in  a  realistic  environment  Because  the  system  is  highly  evolved  by  that  stage,  die 
equipment  mission,  and  environment  will  normally  be  represented  in  considerable  detail. 
It  is  important  that  the  outputs  be  precise  enough  to  match  the  detail  of  the  design 
objectives,  and  sufficiently  diagnostic  to  pomit  identification  of  specific  system 
deficiencies,  where  they  occur.  The  models  and  simulations  enqiloyed  for  T&E  purposes 
will  normally  have  for  all  the  represented  conqxMients  the  highest  levels  of  fidelity  that 
techntdogy  and  resources  pennit 

In  the  traimng  of  warfighting  skills^  the  focus  of  attention  is  on  the  human 
conqxHirats  more  than  on  die  hardware.  The  objective  is  to  provide  operators  widipnicfice 
in  using  their  platforms,  weapons,  and  related  equipment  as  weapons  systems  cqierating  in 
a  coordinated  batde  situation  in  response  to  a  common  threat  Foreachofitscooqionents, 
die  simulation  requires  only  diat  level  of  fidelity  whidi  allows  realistic  practice  to  occur  and 
enables  the  desired  set  training  objectives  to  be  met  It  is  inqxxtant  for  exanqile,  that 
the  simulation  allows  operators  to  obtain  correct  cues,  to  follow  dieir  standard  procedures, 
and  to  receive  appropriate  feedback.  On  the  other  hand,  it  is  not  important  that  the 
simulation  present  a  perfect  functional  replica  of  the  actual  equipment  Only  those 
conqionents  dial  ate  needed  for  the  mtended  troutifig  use  should  be  represented  in  full  detail 
and  widi  "full  fidelity."  Because  warfighting  training  involves  the  learning  and  practice  of 
complex  procedural  and  cogiutive  skills,  the  simulation  focus  needs  to  be  on  precision  in 
replicating  operator-controlled  processes^  more  than  on  the  accuracy  of  hardware 
representation. 

In  tactics  or  concepts  and  doctrine  development^  die  simulaticm  is  employed  with 
men-in-the-loop,  but  with  equal  emphasis  on  the  hardware  (weapon  systems)  and  the 
humans  who  operate  and  maintain  the  systems.  This  usage  has  to  do  with  the 
establishment  of  the  principles  of  warfare,  as  well  as  the  procedures,  as  diey  are  to  be 
practiced  by  our  forces.  In  shmt,  it  is  to  try  out  new  concqits  and  doctrine,  to  identify  the 
optirmim  alternatives,  to  test  dieir  generality  in  different  simulated  battlefield  situations,  and 
finally  to  establish  the  new  concepts  and  doctrine  in  the  Services'  documentation  for 
operaticms  and  training.  Since  the  purpose  of  this  type  of  simulatitm  is  to  examine  the 
possibility  of  unanticipated  events,  an  approximate,  but  not  necessarily  precise,  level  of 
fidelity  is  acoeptaUe. 
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Weapons  ccmcept  analysis  (WCA)  invdves  the  evaluaticm  of  ideas  for  new  weapon 
capabiMes-ideas  for  what  are  somedmes  called  notional  systems.  Given  the  availability  of 
a  DIS  that  represents  stnne  battlefield,  such  an  analysis  can  be  made  even  if  only  a 
preliminary  outline  is  available  regarding  how  the  notional  system  might  fimction.  The 
objective  of  the  WCA  is  to  determine  if  and  how  die  new  capability  might  affect  batdefield 
outcomes,  ovar  and  above  the  outctmes  attainable  with  existing  capabilities  (i.e.,  the 
marginal  contributicm  of  the  notional  system).  Based  on  those  outtxmies,  the  decisitm  can 
be  made  on  whether  further  development  of  the  cmcept  is  warranted,  and  if  so,  to  deGae 
die  ranges  ofkey  parameters  to  be  associated  with  die  notional  system.  WCA  is  a  relatively 
coarse  screen;  it  is  intended  to  permit  early  elimination  of  diose  concepts  duu  lack  merit  as 
potential  solutitms  to  identified  problems,  and  cm  the  other  hand,  to  hig^glit  the  concqits 
that  have  the  greatest  potential  payoff.  Thus,  die  simulations  duit  siqipott  WCA  need  not 
be  extremely  precise,  since  the  objective  is  to  sort  ccmcepts  into  broad  decisicm  categories 
(e.g.,  to  discard,  to  withhold  judgment  until  more  data  are  avalable,  or  to  accelerate 
development).  Likewise,  die  fidelity  requited  for  such  decisions  is  somewhat  lower  than 
duu  needed  for  most  of  die  other  modeling  and  simolation  applications. 

Piqiers  suggested  for  further  reading  on  topics  related  to  Questicm  3  include  Hays 
and  Singer  (1989,  Chs.  1, 12),  Hodges  and  Dewar  (1992),  and  Meister  (1990). 

4 .  I  understand  that  fidelity  is  a  complicated  term.  Is  there  a  better  way  to 
talk  about  all  these  different  aspects  of  fiddity? 

In  the  previous  tespcmse  to  (Question  2,  we  indicated  that  there  is  no  single 
definition  of  fidelity,  but  rather  dud  at  least  22  different  dffinitions  have  been  used  in  die 
literature  to  refer  to  different  kinds  of  fidelity  (physical,  equipment,  psychological, 
perceptual,  functional,  procedural,  task,  logistic,  threat,  etc.).  Although  not  everyone 
agrees  with  all  die  details,  there  ate  now  some  appealing  trends  toward  clustering  diese 
definitions  into  three  different  terms  (fidelity,  realism,  and  validity)  to  rqxesent  or  take  the 
place  of  bodi  die  older  idea  of  fideli^  being  a  unitary  prapexty  or  the  later  identification  of 
more  dian  a  score  of  different  possible  fidelity  properties  of  siinnlations. 

In  die  new  usage,  fidelity  is  stricdy  an  engineering  term  diat  refers  only  to  die 
pkysiatl  correspondence  of  the  simulator’s  hardware  to  that  of  the  actual  equqmient  being 
rimulated.  Dotfa^locdcdiesame?  Do  die  omtrcds  and  switdies  work  die  same  wi^? 

The  seccmd  concq>t  is  that  of  realism.  Realism  refers  to  die  perceptions  and 
subjective  judgments  of  the  people  using  die  simulations-do  diey  perform  and  qqiear 
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sufficiently  close  to  the  real  systems  and  equipments  (to  reality,  in  brieO  to  pemait  and 
support  effective  training  or  evaluatitm?  To  the  extent  that  the  answer  to  this  question  is 
yes,  the  simulation  can  be  said  to  exhibit  an  associated  degree  of  realism. 

Validity  is  the  third  of  the  three  concepts.  Validity  refers  to  the  suitability  of  the 
simuladcm  for  a  specie  (^plication.  Does  the  simulatitm  permit  the  operator  to  attain  a 
desired  training  objective  or  level  of  task  proficiency?  Can  a  new  system  or  tactic  be 
evaluated  at  a  level  of  precision  that  would  permit  or  support  decisions  regarding  the 
system’s  probable  effectiveness?  (Validity  also  has  some  different  specific  meaninp  for 
the  military  modeling  and  simulaticMi  community;  more  will  be  presented  on  these 
differences  later  in  this  paper.) 

Using  these  three  terms  allows  for  a  much  clearer  examination  of  the  issues 
involved  in  asking  simulation  questions.  For  exaiiq)le,  fidelity  (engineering)  as  sudt  is  not 
very  inqxxiant  for  simulation  exc^  as  it  iaq)acts  validity,  aldioug^  it  is  (or  can  be)  a  major 
cost  driver.  Realism  is  inqMxtant  largely  because  of  its  role  in  affecting  user  accq>tance; 
indeed,  sometimes  simulations  that  vary  considerably  in  engineering  fidelity  differ  only 
unimportantly  in  perceived  realism.  Validity  is  inqxvtant  because  it  reminds  us  diat  any 
judgaamt  of  the  suitability  of  a  amulatkm  can  be  made  only  in  reference  to  its  intended  use 
in  a  specific  and  wcH-defuied  applicatioa. 

The  word  fidelity  may  sometunes  be  acceptable  as  a  convenient  shorthand  for 
conveying  a  general  idea  of  likraess  between  die  simulation  and  the  "real  worid."  Use  of 
the  word  in  diat  way,  however,  sheds  litde  or  no  light  on  die  underlying  issues  (Le.,  issues 
of  fidelity,  realism,  or  validity-engineering,  percqition,  or  suitalnlity).  Radier,  it  tends  to 
get  in  the  way  <rf  communicating  about  specific  simulations,  and  confuses  die  more  precise 
usages  that  are  necessary  to  address  the  simulatitm  issues  of  greater  importance.  In  the 
l<mg  term,  new  and  more  definitive  terminology  must  be  devdoped  to  support  discussion 
of  these  issues. 

Ptqiers  suggested  for  further  reading  on  topics  related  to  Question  4  include  Hodges 
and  Dewar  (1992),  Jones,  Hennessy,  and  Deutsch  (1985),  and  l^filliams  and  Sikora 
(1991). 

5.  But  don't  I  still  need  to  know  how  much  fidelity,  realism,  validity  (or 
whatever)  I  should  have  for  a  particular  simulation? 

The  obvious  answer  would  seem  to  be,  "All  you  can  afford."  That  is  probatdy 
correct  for  some  applications  like  test  and  evaluation,  but  it  is  often  not  true  for  training. 
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Sometimes  all  the  fidelity  you  can  afford  isn't  good  enough,  so  you  have  to  use  real 
equipment  in  real-world  field  exercises  even  though  such  (q)erating  time  (OPTEMPO)  is 
noore  expensive.  For  exanqple,  the  finer  points  of  vdiicular  control  camiot  be  fully  trained 
with  eidier  DIS  or  conventional  simulation;  practice  in  conmdling  actual  vehicles  is  required 
to  attain  the  higgler  levels  of  motor-oxitrol  skills. 

At  other  times,  all  the  fidelity  you  can  afford  may  be  too  muck  for  optimum 
training-for  acampk,  at  early  stages  in  the  learning  process  when  the  trainee  is  likdy  to  be 
confused  by  the  full  oooqtlexity  of  the  weapm  system  he  is  trying  to  learn  to  operate  or 
maintain.  The  trainee  is  then  moe  likely  to  learn  better  and  faster  if  presented  witii 
sirrqrlified  representations  that  are  sufficient  to  get  across  the  idea  to  be  learned,  but  from 
which  distractions  and  conqrlexities  have  been  reduced.  Htudly,  because  it  assumes  tiiat 
individual  trainees  are  fully  qualified  individually  on  tiieir  wetqxm  systems,  DIS  is  ofien 
inappropriate  for  use  in  training  basic  job  skills  regardless  of  die  level  of  fiddity. 

Ptqiers  suggested  for  further  reading  on  topics  related  to  Question  5  include  Hays 
and  Singer  (1989,  Oi.  3),  and  Waag  (1981). 

6.  b  it  really  possible  to  have  too  much  fidelity? 

Yes!  Absolutely!  As  hinted  above,  too  tmich  detail  and  loo  much  realism  can  get  in 
dK  way  of  learning  basic  skills  and  procedures,  particularly  in  the  earliest  first  stages  of 
training  <m  a  given  task.  Real  worid  tasks  tend  to  be  oonqrlex,  and  in  order  to  help  the 
trainee  understand  how  die  task  procedures  ba^ally  work,  it  is  offcn  advantageous  to  strip 
away  some  of  the  conqilexiQr,  sinqilify  the  task,  and  even  to  stop  and  rqilay  task  situations 
(or  use  similar  tedmiques)  to  convey  to  die  trainee  vdttt  he  is  stqiposed  to  do  and  how  he  is 
stqipoaedtodoiL  However,  aldioug^  a  relatively  high  levd  of  fidelity  mi^  be  a  handicq) 
during  certain  early  stages  of  karoing,  it  might  also  be  a  near-abstdute  requirement  during 
later  stages. 

Thus,  in  designing  a  training  system,  all  die  resources  dut  could  be  used  in  the 
desiied  training  should  be  taken  into  account,  with  each  of  die  resources  consklkted  for  use 
as  port  of  a  compkie  or  full  training  system.  Then,  the  final  design  should  be  based  on 
selecdons  of  resources  duu  tend  to  optimize  (if  not  maxitnize)  training  cost-effectiveness  if 
used  in  die  ways  defined. 

Pqters  suggested  for  further  reading  on  topics  related  to  (Question  6  include 
Semple,  et  aL  (1981),  and  Waag  (1981). 
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7 .  When  I  ask  about  fidelity,  people  keep  telling  me,  "It  all  depends." 

Why  can't  I  get  a  straight  answer? 

Because  it  does  depend-cHi  what  you  intend  to  use  the  simulation  for.  When 
you're  training  things  like  operating  procedures,  communicatitm,  decisitm  making,  and 
tactics,  hig^  fidelity  in  vehicular-handling  characteristics  doesn't  add  anything  except  to  the 
cost.  If  you're  primarily  interested  in  training  manual-control  skills,  the  answer  is 
obviously  different 

The  best  way  to  get  a  good  answer  to  die  fidelity  question  is  to  take  a  closer  lotdc  at 
just  exactly  what  the  simulation  is  intended  to  accomplish.  A  good  qiproach  is  to  build  die 
simiilatinn  fixxn  the  ground  up  by  matching  the  characteristics  of  each  cooqxxient  and 
subcomponent  to  a  defined  purpose  or  intended  use  of  the  simulation.  Each  fidelity 
decision  must  be  systematically  based  on  a  specific  requirement.  We  call  this  ^proach 
fidelity  anchoring.  It  is  less  costly  and  more  effective  than  the  older  iqiproach,  which 
sought  to  ccMi^ute  a  training-effectiveness  value  attributable  to  each  fidelity  (realism  or 
validity)  conqxxient,  first  by  constructing  the  hi^st  level  of  fidelity  (realism  or  validity) 
achievable  for  the  entire  simulation,  and  then  by  omitting  or  degrading  selectively  the 
fidelity  conqionents  while  measuring  the  training  effectiveness  obtained. 

8 .  What  was  that  about  fidelity  anehoringt 

Rdelity  anchoring  is  an  lyproach  to  deciding  how  a  simulator  or  simulati<»  should 
be  designed  in  order  to  meet  its  objectives  widi  minimum  cost  and  coaq>lexity.  Itptesumes 
(not  unreasonably)  that  we  can  ^lecify  what  the  Emulation  is  intended  to  accomplish  and 
the  probable  range  of  applications  for  which  it  will  be  used.  Given  that  information,  tiie 
premise  is  diat  each  decision  about  die  qtpearance  and  operation  of  the  simulation  must  be 
justified  (or  anchored!  by  a  systematic  examination  of  lequnements.  The  three  anchoring 
criteria  that  can  justify  inoeases  or  decreases  in  fidelity  or  realism  of  a  component  are 
effectiveness^  user  acceptance^  and  effonkMUty.  Effectiveness^  much  like  validity ^  has  to 
do  with  how  well  die  simulation  does  what  it  purports  to  do~dutt  is,  how  well  it  achieves 
its  intended  purpose. 

The  three  critoia  are  related  to  one  another,  but  not  in  any  single  way.  For 
exaiiq)le,  raising  the  fidelity  of  a  component  is  almost  always  associated  with  higher  cost^ 
and,  tii/cniattt  lower  affordaitility^  but  might  not  change  effectiveness  oe  user  accqttance  at 
all.  In  general,  increases  in  fidelity  will  be  associated  with  increases  in  user  acceptance 
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only  where  the  available  fidelity  is  nrarginal  for  the  specific  application  in  question. 
Effectiveness  may  be  associated  widi  user  acceptance,  but  (Hily  over  a  very  narrow  range. 

The  objective  of  fidelity  anchoring  is  to  ensure  that  every  compcment  of  a 
simiilarion-evety  aspect  of  how  it  lodcs,  feels,  and  q)erates~should  have  die  exact  degree 
of  fidelity  required  by  its  intended  triplication,  but  no  more  and  no  less.  To  design 
properly  the  simulators  and  other  training  devices  to  be  included  in  a  total  training  system, 
<me  should  take  into  account  not  only  the  aspects  oi  the  training  system,  but  also  diose  of 
the  qperaticmal  plan  for  weiqMm  system  usage.  For  exanqile,  if  die  operational  use  of  an 
aircraft  system  specifies  that  pilots  are  to  fly  so  many  missitMis  per  month,  with  so  many 
takeoffs  aral  landings,  it  may  be  that  such  operadtxial  use  win  provide  sufficient  practice  in 
executing  takeoffs  and  landings  to  preclude  the  need  for  additi<»al  practice  of  that  function 
in  simulators  or  odier  training  devices  widiin  the  tcxal  training  system. 

9.  OK,  I  understand  now  what  fidelity  anchoring  is  intended  to  do.  How 
does  tme  go  about  doing  that? 

The  process  of  fidelity  andioring  is  ondined  bridly  over  the  next  few  pages.  While 
the  process  appears  to  be  complicated,  it  is,  in  reality,  only  a  sequence  of  relatively 
straightforward  decisioas.  It  is  1^  no  mearu  necessary  to  follow  die  full  development  of 
fidelity  anchoring  to  appreciate  its  logic.  The  essential  idea  is  that  decisions  on  both 
coffiguring  a  simulation  system  and  investing  the  resources  for  it  should  be  based  on  a 
systematic  rational  examinatkMi  of  how  that  specific  sinudation  is  to  be  used.  In  diat 
context,  generalities  about  the  pros  and  cons  <rf  hi^  and  low  fidelity  are  not  very  hdpfuL 
Instead,  fidelity  anchoring  calls  for  a  detailed  examination  of  die  simulation  requirements 
on  four  key  diiiiensionsor)ldffiiy  drivers.  Sinuikaion  requirements  are  then  systematically 
aiialyzed  and  cross-cornpared  to  derive  jSdefiiyrequtremeiiCs.  The  four  key  fidelity  drivers 
are  identified  and  discussed  below  and  on  the  following  pages: 

a.  MiasionCs)  or  Mission  Segments  To  Be  Simulated.  For  realistic 
practice  or  evaluation  to  occur,  die  system  must  be  used  to  perform  some 
mission.  We  may  wish  to  simulate  all  mission  phases  or  (fiequentiy)  only 
selected  segments  of  a  mission;  fix’  exanqile,  it  may  be  unnecessary  to 
sfanulate  in  full  detail  routine  actions  during  extended  periods  of  transit  time  to 
abattlearea. 

For  example,  Hgure  1  shows  a  night  mterdiction  mission  profile  for  die  A-6E 
ahcraft,  widi  16  mission  segments.  For  a  given  nmulatitm  system,  we  may 
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Figure  1.— A  Representative  Mission  Profile 


need  the  ciq)ability  to  simulate  (a)  all  of  these  in  detail,  (b)  only  those  that 
involve  potential  interaction  with  specific  classes  of  threats,  or  (c)  any  other  set 
of  interest 

The  segments  that  we  elect  to  include  in  die  simulation  will  dictate  die  specific 
tasks  to  be  performed  by  the  operattn’,  the  system  components  involved  in 
performing  these  tasks,  and  thus  the  simulation  components  on  which  fidelity 
anchoring  should  be  focused. 

b.  Objectives  of  the  Simulation.  A  simulation  is  intended  (a)  to  provide 
practice  on  specific  skills,  (b)  to  reinfcmce  acquisition  and  use  of  job-relevant 
knowledge,  or  (c)  to  evaluate  a  system  or  a  new  weapons  concept  These 
potential  objectives  can  be  described  in  terms  of  broad  dasses  of  basic  operator 
activities  that  the  simulation  does  or  does  not  need  to  stqpport  (i.e.,  provide  a 
capability  to  peifonn). 

Hgure  2  lists  representative  activities  or  objectives,  some  or  all  of  which 
(including  others  from  different  lists)  might  be  required  to  perform  tasks 
during  selected  mission  segments.  There  are  two  distinct  kinds  of  activities: 
(a)  platform-related  activities  are  those  tiiat  invdve  tiie  (^leraticm,  ctmtrol,  and 
maneuvering  of  a  vehicle  or  single  weapon  system,  and  (b)  mission-related 
activities  are  those  required  to  enqilc^  that  weapon  system  in  a  battlefield 
context  as  part  of  a  coordinated  effort  witii  otiier  platforms  in  reqionse  to  a 
common  threat~in  short,  activities  involved  in  practice  or  demonstraticm  of 
warfighting  tidlls. 

The  fiddity  required  to  meet  specific  objectives  would  be  based  (» the  extent  to 
triiich  each  of  the  identified  activities  that  occur  within  a  mission  segment  must 
be  siqiported  by  die  simulation,  and  in  what  detail.  Note  diat  activities  must  be 
cross-referenced  to  segnoents.  Not  all  activities  will  occur  in  all  segmrats,  and 
the  fidelity  requned  by  a  given  activity  may  differ  across  segments. 

We  have  thus  far  considered  two  of  die  four  fidelity  drivers-two  factors  of  fiddity 
anchoring:  (a)  the  mission(s)  or  mission  segments  to  be  performed,  and  (b)  die  objectives 
to  be  achieved,  defined  in  terms  of  the  operator  ocnvitiesfo  be  emrcised.  Theremaining 
two  of  die  four  are  identified  and  discussed  as  follows: 

c .  Fidelity  Dimensions.  The  dimensitMis  on  which  fidelity  can  be  examined 
and  evaluated  can  be  grouped  Into  three  general  classes:  there  are  dimensiems 
that  show  and  describe  the  attributes  of  (a)  the  simulator,  including  its 
workstation  and  its  task  environmmt,  (b)  die  operator  or tasking,  and 
(c)  die  processes  or  events  ^eternal  to  the  simulator  itself . 
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Figure  2.  Simulation  Objectlvoa  (Aetivltloa  To  Be  Trainad, 
Praeticad.  or  Evaiuatad) 


Platform-Ralatad  Activitiaa 

•  Using  Procedures  and  Principles 

•  Using  Discrete  Motor  Skills 

•  Using  Continuous  Motor  SkUs  (Psychomotor) 

•  Making  Perceptual  or  Sensory  Discriminations 

•  Communication  (intemaQ 

Mlaalon-Ralatad  Activities 

•  Familarization 
-Terrain 

-Threat  Characteristics  or  Behavior 

•  Applying  Tactics  or  Rules  of  Engagement 

•  Planning 
-Mission  Profiles 

-Logistics  (Fuel.  Ordnance,  etc.) 

•  Coordination  with  Other  Platforms 

•  Communication  (Internal  and  ExtemaQ 


Figure  3  lists  some  of  the  characteristics  Aat  make  up  these  three  classes  of 
fidelity  dimensimis.  Although  all  duee  classes  must  be  considered  in  fidelity 
anchoring,  the  distinctions  among  the  classes  are  particulariy  critical  for  DIS. 

The  first  class  of  attributes  describes  die  (simulated)  system  itsdf  and  how  it 
fimctions  as  a  fieestanding  entity  independent  of  any  simulatitm  network;  the 
concerns  foe  fidelity  here  are  those  that  address  the  operators  equipment  and 
its  immediate  environment-die  look  and  feel  diat  are  the  results  of  the  physical, 
sensory,  and  perceptual  variables  en^loyed.  These  are  basic  aspects  that  need 
to  be  considered  for  all  simulations,  ctmventional  or  DIS. 

Tasking  attributes  are  drivers  dutt  determine  the  qiecific  tasks  to  be  performed 
by  the  operator  and  the  task  loading  under  which  he  wiU  work.  Note  diat  diese 
drivers  are  external  to  the  system-what  die  c^ierator  does  in  the  simulati<»  is 
determined  by  how  die  simulated  system  is  used.  These  drivers  are  present  in 
both  DIS  and  conventional  simulatitm.  In  conventional  simulatitm  they  are 
likely  to  be  built  into  the  simulator,  whereas  in  DIS  they  are  mne  likely  to  be 
heavily  influenced  the  activities  of  other  entities. 
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Figure  3.  Fidelity  Dlmensione 


Some  Attrlbutee  of  the  ~ 

-  Simulator 

•  Appearance  of  equipment  (“looks  like”) 

•  Discrete  operation  of  system  (switches,  discrete  controls) 

•  Continuous  operation  of  system  (dynamics,  control  response,  feedback) 

•  Sensory  stimulation  (motion,  visual,  sound) 

•  Physical  environment  (heat,  cold,  vibration,  illumination) 

•  Perception  of  simulation  by  hurruui  (cfiscriminability  of  stimul  and  cues) 

-  Tasking 

•  Task  characteristics  (cues,  procedures) 

•  System  employment  (force  organization,  logistics) 

•  Demands  of  the  operator  (loading,  pacing,  OPTEMPO) 

••  Simulation  Process 

•  Characteristics  of  other  operators  (experience,  training,  aptitude) 

•  Characteristics  of  threats  (emissions,  signatures,  capabilties.  numbers) 

•  Behavior  of  threats  (deptoyment,  tactics,  rules  of  engagement) 

•  Characteristics  of  own  forces  (emissions,  signatures,  capabilties,  numbers) 

•  Behavior  of  own  forces  (tactics,  mies  of  engagement) 


The  attributes  of  external  processes  generally  arise  from  the  dynamics  of 
sjfstem  participation  in  the  intoactive  events  of  die  battlefiekL  Although  some 
of  these  attributes  are  present  in  ctxivaitimial  simulatimi,  they  are  much  more 
complex  and  much  richer  in  DIS.  Each  of  diese  attributes  and  characteristics 
defines  a  dimension  of  fidelity,  and  each  requires  decisions  about  the  level  of 
fidelity  at  which  that  attribute  will  be  represented  fOT  a  component  of  the 
simulation  within  the  context  defined  the  missions  and  objectives  of  the 
desired  training. 

d.  Simulation  Components.  As  suggested  by  the  prior  discussion,  a 
siixuilaticm  can  be  thought  of  as  one  or  more  simulators  interacting  as  required 
by  the  evolving  scenario.  In  the  larger  context  of  DIS,  the  process  may 
involve  not  only  simulators,  but  also  actual  equipment  and  computer  models 
(automated  forces  and  evaluatkm  rules). 
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Execution  of  a  simulation  requires  the  presence  of  numerous  simulation 
components.  Figure  4  shows  one  way  of  breaking  down  a  DIS  simulation 
process  into  a  set  of  components.  Note  that  these  are  logical,  but  not 
necessarily  physical  components;  that  is  to  say,  there  may  not  be  a  specific  box 
or  piece  of  equipment  that  corresponds  to  each  identified  conqxment. 

Note  also  that  the  compcments  are  subdivided  into  local  and  global  sets.  Local 
componoits  are  part  of  the  simulator  and  its  immediate  environment;  they  have 
roughly  the  characteristics  defined  as  attributes  of  the  simulator  in  Figure  3. 
Global  components  are  defined  by  the  external  processes  and  environments 
with  which  the  local  components  interact  The  importance  of  breaking  down  a 
simulation  into  its  building  blocks  is  that  it  is  about  these  individual 
components  that  fidelity  decisions  must  be  made.  Thus,  fidelity  anchoring  is 
applied  to  decide  which  components  require  what  kind  and  level  of  fidelity. 

10.  So  we  have  four  sets  of  dimensions.  How  do  we  use  them  to  make 
fidelity  decisions? 

The  four  key  fidelity  drivers  just  discussed  constitute  four  dimensions  on  which 
any  given  simulation  can  be  analyzed.  In  the  analytic  process  of  fidelity  anchoring,  these 
four  dimensions  are  combined  with  three  criteria  to  lead  us  to  appropriate  simulator-fidelity 
decisions.  Two  criteria,  training  effectiveness  and  user  acceptance^  are  employed  in  the 
earlier  stages,  whereas  the  third  criterimi,  effordability  constraints,  becomes  relevant  only 
after  we  have  identified  alternative  possible  simulator  configurations.  Thus,  we  complete 
the  process  of  fidelity  anchoring  by  cross-comparing  the  alternatives  on  certain 
combiruitions  of  these  dimensicMis  and  criteria.  Our  ultimate  objective  is  to  determine,  for 
each  component  (as  in  Figure  4),  on  each  fidelity  dimension  (as  in  Hgure  3),  the  degree  of 
fidelity  required  to  support  the  intraded  uses  of  the  simulation. 

The  process  of  fidelity  anchoring  involves  four  stages  as  follows: 

a.  In  the  first  stage,  we  determine  which  fidelity  dimensions  are 
relevant  to  each  simulation  component.  Consider  a  two-way  matrix 
fcmned  by  the  intersecticms  of  die  24  simulation  coirqKments  (see  Figure  4) 
with  the  14  fiddity  dimensions  (see  Hgure  3).  The  result  is  a  matrix  of  336 
cells  that  could  be  examined.  For  each  cell,  we  must  make  a  relevance 
judgment  While  this  seems  initially  to  be  a  large  number  of  relevance 
decisitms,  in  most  cases  only  a  very  lirruted  set  of  cells  will  actually  be 
examined,  because  not  all  fidelity  dimensions  are  associated  with  all 
conqmnents.  Fm  exarr^le,  in  evaluating  the  woikstaticm  conqxxient  we  are 
not  ccmoenied  with  any  attributes  of  die  simulation  process  or  with  most  of  die 
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Figure  4.  Components  of  a  Distributed  Interactive  Simulation  (DiS) 


LOCAL  — 


GLOBAL— 


Simulator 

•  Workstation 

—  Controls/Dispiays 

—  Models  or  Equations  of  Vehicles  and  Weapons 

•  Physical  Environment  (Atmosphere,  Cold,  Heat,  Light,  Vibration,  etc.) 

•  Sensory  Environment  (Auditory,  Visual,  Motor,  etc.) 

Database  (Local) 

•  Gaming  Area 

•  Terrain 

•  Object  Representation  (State.  Location.  Attributes) 

Operator(s) 

•  AptMude 

•  Training 

•  Experience 

Mission  Characteristics 

•  Procedures 

•  Tactics/Rules  of  Engagement 

•  Profiles/Scenarios 

Other  Entities 

•  Actual  Equipment 

—  Threats 

—  OwnFbrces 

•  Simulated 

—  Threats 

—  Own  Forces 

•  Semi-Automated/Automated 

—  Threats 

—  Own  Forces 

Database  (Global) 

•  Object  Representation  (State,  Location,  Attributes) 

Network 

•  Protocols 

•  Object  and  Entity  Data 

—  State  Changes 

—  Location  Changes 


tasking  attributes,  and  thus  need  to  make  relevance  judgments  over  no  more 
than  a  dozen  or  so  cells.  Similarly,  relevance  judgments  will  be  required  over 
only  a  small  fraction  of  the  total  336  intersection  cells.  Only  the  relevant  cells 
will  be  considered  in  later  sequences  of  fidelity  anchoring. 

b.  In  the  second  stage,  for  each  relevant  combination  identified  in 
stage  1,  we  determine  the  highest  fidelity  required  to  attain  the 
desired  simulation  objectives  (see  Figure  2)  in  any  mission 
segment  to  be  simulated  (see  Figure  1)  on  either  of  two  criteria 
(effectiveness  and  user  acceptance).  In  other  words,  for  a  given 
fidelity  dimension-component  combination,  we  look  through  all  the  possible 
things  that  we  might  want  to  train  or  evaluate,  and  we  lode  across  all  segments 
of  all  missions  to  be  trained,  and  decide  on  (make  a  judgment  regarding)  the 
highest  level  of  fidelity  that  ought  be  needed  in  the  intended  use  of  the 
simulation.  Further,  we  make  this  judgment  on  either  of  two  bases—a  given 
level  of  fidelity  may  be  required  either  to  nuike  the  simulation  sufficiently 
effective  or  to  achieve  a  desired  level  of  user  acceptance  indq)endent  of 
effectiveness-and  we  take  the  higher  of  the  two.  The  fidelity  required  could 
be  assessed  on  a  variety  of  scales,  but  the  simplest  scale  would  likely  be  the 
three-point  rating,  HigK  Medium^  or  Low.  After  all  this  work,  we  end  up 
with  a  single  data  point  for  each  relevant  combination,  the  highest  fidelity  tiuu 
we  found  in  any  simulation  objective  evaluated  across  segments  and  across 
criteria.  We  repeat  the  operations  of  Stage  2  for  every  relevant  combination 
from  Stage  1,  and  for  each  of  the  missions  that  might  be  of  interest,  and  then 
move  on  to  Stage  3  with  a  collection  of  High,  Medium,  ot  Low  judgments  for 
diese  combinations. 

c.  In  the  third  stage,  we  return  to  our  Stage-1  two-way  matrix 
(conq)osed  of  fidelity  dimensions  crossed  with  simulation  components)  and 
enter  into  each  relevant  cell  the  highest  fidelity  judgment  we 
determined  in  Stage  2,  and  use  those  entries  in  deciding  how  to 
go  about  designing  each  component  to  have  exactly  the 
appropriate  level  of  fidelity  on  each  fidelity  dimension.  Fot 
exaiiq)le,  given  our  look  at  objectives,  missioiis,  and  criteria,  we  might  have 
determined  that  the  simulation's  workstation  conqxment  requires  a  high  level 
of  fidelity  <mi  discrete  (^>erati<xi  of  equipment,  but  only  medium  fidelity  (»i 
q>pearance  of  equipment,  and  a  low  levd  of  fidelity  cm  threat  characteristics. 
We  may  find  diat  there  are  no  requiremoits  for  maitipulation  of  the  simulator's 
physical  environment,  and  that  die  soisory  environment  requires  medium 
fidelity  visual,  but  with  no  requirement  for  motion  or  sound.  Thus,  by  going 
through  the  first  three  stages,  we  have  anchored  our  fidelity  judgments  in  a 
orderly,  systematic  examination  d  what  the  simulation  is  intended  to  do. 
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d.  In  the  fourth  and  final  stage*  we  introduce  our  third  criterion  for 
fidelity  of  a  simulation— affordability.  After  we  have  decided  through 
careful  analysis  what  our  simulatiai  characteristics  should  be,  we  may  find  that 
we  cannot  afford  some  of  the  desired  levels  of  fidelity.  Indeed,  some  of  the 
intended  uses  of  our  simulation  may  require  us  to  network  numerous 
simulators,  and  it  may  be  necessary  to  compromise  some  of  our  fidelity 
requirements  in  order  to  afiord  the  additional  simulator-units-that  is,  to  reserve 
the  resources  to  acquire  simulator  units  in  the  required  quantities.  Again 
fidelity  anchoring  is  useful.  By  the  end  of  Stage  3,  we  know  rather  precisely 
those  components,  missions,  and  objectives  that  are  the  major  fidelity  (and 
thus  cost)  drivers,  and  can  woik  backward  from  our  Stage  3  matrix  to  identify 
where  requirements  may  be  eased  with  least  loss  of  usefulness  for  the 
simuladai  and  in  achieving  its  objectives. 

11.  I’m  confiised  about  the  logic  of  using  the  highest  fidelity  requirement. 
Aren't  we  trying  to  reduce  unnecessary  fidelity? 

It's  true  that  the  reason  for  going  through  a  process  like  fidelity  anchoring  is  to 
make  sure  that  a  comptment  has  the  kinds  and  degrees  of  fidelity  appropriate  to  that  for 
which  we  want  to  use  the  simulatimi.  However,  if  we  examine  what  goes  mi  in  Stage  2, 
we  will  see  that  the  logic  of  identifying  the  highest  fidelity  requirement  is  carried  out  cm 
combinations  of  objectives  and  mission  segments.  Once  we  have  determined  a  simulation 
configuraticm,  that  is  the  cmifiguration  that  must  be  used  for  all  the  included  objectives  and 
mission  segmoits  to  be  addressed;  tiiat  is,  the  fidelity  of  a  conqionrat  cannot  be  changed  as 
the  simulated  missimi  moves  from  one  segment  to  another.  Even  if  only  one  objective  or 
mission  segment  in  our  intended  use  requires  a  givra  high  level  of  fidelity,  that  is  die  level 
that  would  have  to  be  provided-even  if  every  odier  objective  and  segment  called  for  only 
low  levels  of  fidelity.  Fortunately,  die  process  of  fidelity  anchoring  will  identify  such 
imbalances  where  diey  occur,  and  we  can  dien  reevaluate  the  situation  to  decide  whedier  we 
really  need  to  include  the  objective  or  mission  segment  that  requires  die  high-level  fidelify. 

12.  We've  spent  a  lot  of  time  on  fidelity  anchoring.  Why  are  you  so 
concerned  about  it? 

In  gmeral,  the  higher  the  fidelity  needed  for  a  simulation,  the  more  it  costs  to 
design,  build,  and  maintain.  In  other  words,  the  higher  the  fidelity  of  a  simulation,  the 
higher  its  life  cycle  costs.  Increases  in  life  cycle  costs  are  not  proportional  to  inocases  in 
fidelity.  Small  increments  in  fidelity  can  multiply  costs  dramatically.  In  addition,  die 
increased  system  conoplexity  associated  widi  achieving  higher  fidelity  is  associated  widi 
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decreases  in  the  reliability  and  the  availability  of  simulation  equipment.  Given  these 
conditions,  we  obviously  do  not  want  to  pay  for  any  more  fidelity  than  we  need.  Fidelity 
anchoring  is  one  way  of  forcing  a  systematic  justification  of  fidelity  requirements  and 
ensuring  that  fidelity  decisions  are  based  (mi  identified  uses  of  the  simulation. 

Not  having  to  pay  for  more  fidelity  than  you  need,  clearly  important  for 
conventional  simulations,  is  even  more  critical  for  DIS  q)plications.  DIS  is  nx>st  valuable 
fen*  large-scale,  multiple-entity  simulations  suitable  for  the  training  of  warfighting  skills 
through  coordinated  unit  (collective)  training,  or  for  evaluating  how  proposed  (or  actual) 
weapon  systems  or  tactics  perform  in  the  context  of  a  realistically  simulated  battlefield. 
Realistic  two-sided  free-play  exercises  using  DIS  could  involve  dozens,  and  pertiaps 
hundreds  or  thousands  of  workstations.  Other  than  actual  field  exercises,  DIS  is  the  only 
way  to  accon^lish  some  of  these  very  large-scale  training  or  evaluation  objectives.  To 
make  such  DIS  exercises  possible,  simulations  and  dieir  components  must  be  affordable— 
and  in  sufficient  quantities  to  permit  achievement  of  die  objectives  of  their  use.  Systematic 
attention  to  fidelity  is  key  to  resolving  affordability  issues. 

13.  I  notice  that  fidelity  anchoring  uses  relative  judgments  of  fidelity 
requirements  (high,  medium,  or  low).  Isn't  there  some  better  way  to 
quantify  fidelity? 

At  present,  fidelity  is  a  metric-free  construct  with  no  agreed-upon  measurement 
scale  on  which  the  fidelity  of  a  q)ecific  simulation  can  be  located  and  assigned  a  numerical 
value.  Fidelity  is  not  a  unitary  concept;  it  has  many  dimensimis  and  subdivisions— far  too 
many  to  be  represented  by  any  currently  recognized  single  index.  The  problem  is 
addressed  in  fidelity  anchoring  by  examining  the  fideli^  requirements,  not  of  the 
simulaticm  as  a  whole,  but  of  specific  simulation  contexts;  for  exaixq)le,  a  q)ecific  ctmtext 
defined  by  one  mission  segment  and  cme  objective.  In  such  contexts,  (Hily  tme  dimensiem 
at  a  time  is  of  concern  (e.g.,  how  much  fidelity  is  necessary  for  a  specific  use)  and  for  that 
purpose  it  is  possible  to  make  meaningful  relative  judgments  (e.g.,  medium  represents  less 
fidelity  than  tugh^  but  more  than  low).  We  might  even  be  able  to  convert  those  judgments 
into  numerical  indices,  but  they  would  have  meaning  (»ly  in  that  defined,  limited  ctmtext, 
not  for  the  simulation  as  a  whde. 

There  are  two  problems  with  having  to  maice  relative  judgments  (hi^-medium-low) 
about  fidelity  requirements.  First,  tiiey  are  subjective,  and  different  pe(q)le  might  ccmie  up 
widi  different  values.  There  is  not  much  we  can  do  about  that  It  is  really  not  much 
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different  from  the  educated  guesses  that  we  must  frequently  make  in  simulator  design 
today.  Howevo’,  the  extra  advantage  of  fidelity  anchoring  is  that  it  forces  us  to  take  sonae 
major  drivers  into  explicit  account  It  also  breaks  down  the  simulatUm  into  sinq)le,  specific 
contexts  that  make  the  judgments  more  accurate.  Secondly,  relative  judgments  do  not 
really  tell  us  exactly  how  the  specific  conqxxwnts  and  subemnponents  should  look  and 
operate.  They  (mly  tell  us  that  a  conqxxient  needs  a  lot  of  fidelity  (or  a  little  or  something 
in  between).  If  necessary,  we  could  expand  <Hir  relative  judgment  scale  with  verbal 
anchors  that  say  more  precisely  what  we  mean  by  the  terms  (e.g.,  low  means  a  non¬ 
functional  mockup  can  be  used,  while  high  means  that  the  use  of  actual  equipment  is 
required).  We  could  even  have  several  different  scales,  one  dealing  with  appearance,  one 
with  (^)eration,  etc.  The  ptnxwse  of  fidelity  anchoring  is  to  focus  our  attentitm  <»  the 
things  that  matter;  it  will  not  noake  automatic  decisimis  for  us.  The  technology  for  that, 
simply,  is  not  yet  available. 

We  are  currently  working  on  some  new  ways  of  better  quantifying  fidelity 
requirements  for  some  very  specific  objectives  and  components.  For  example,  in 
simulating  vehicular  ctmtrol,  we  want  to  provide  just  enough  fidelity  (throu^  equations  of 
motiem,  informadon  cemtent,  and  update  rates)  for  the  operator  to  be  able  to  eiiq>loy  the 
same  procedures,  cues,  and  motor  responses  used  in  die  actual  system.  When  we  reduce 
fidelity  below  some  low  pmnt  at  which  the  operator  must  deviate  significantly  fnxn 
established  control  strategies,  we  have  essentially  made  die  control  of  the  rinailated  system 
a  different  task  from  ccmtrol  of  the  actual  system,  and  run  the  risk  that  some  of  our 
objectives  mi^t  not  be  met  as  well  or  even  at  aU.  If  we  could  define  diat  critical  low  point 
quantitatively,  we  would  have  a  way  of  evaluating  a  given  sunulaticn  widi  respect  to  its 
fidelity  for  vehicular  control  Althou^  die  way  we  quantify  a  simulatitm  for  vehicular 
control  does  not  necessarily  generalize  to  other  objectives,  it  does  illustrate  an  inqiortant 
point  about  fidelity  determination;  namely,  that  we  want  to  be  able  to  identify  precisely  diat 
level  of  fidelity  which  minimizes  the  need  for  task  redefinition  dnoughout  die  sunulatkm-- 
that  is,  the  level  that  allows  t^ierators  to  perform  the  tasks  required  by  die  simulation  in 
much  the  same  way,  using  the  same  inframation,  and  widi  die  Mme  speed  as  die  equivalent 
tasks  performed  in  the  actual  system. 

For  findier  reading  on  topics  related  to  Question  13,  see  Meister  (1990). 
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14.  That's  enough  about  fidelity  for  now.  Let's  backtrack  a  bit.  You  keep 
nuking  a  distinction  between  basic  skills  and  warfighting  skills. 

What's  the  difference  and  why  does  it  nutter? 

Basic  skitts  are  all  the  things  the  operator  has  to  learn  to  do  his  or  her  job-that  is,  to 
become  qualified  to  operate  the  system  or  platform.  Basic  does  not  necessarily  mean 
simple.  Some  of  these  “basic”  skills  are  in  fact  very  complex;  they  include  things  like 
flying  an  aircraft  or  operating  a  radar  tracking  system.  But  they  are  primarily  platform 
proficiencies-that  is,  concerned  with  a  single  platform  or  system,  or  perhaps  a  few 
systems  operating  together,  and  are  largely  mastered  by  die  end  of  regular  training.  On  die 
other  hand,  warfighting  skills  have  to  do  with  die  use  of  the  system  in  a  collective  military 
operation-for  example,  as  part  of  a  force-level  or  even  a  theater-level  response,  in 
coordination  with  other  air,  ground,  and  sea  fmces.  There  are  required  skills  (tasks, 
tactics,  and  procedures)  that  go  beycxid  the  toleration  cf  an  individual  system  or  unit  in  this 
larger  batdefield  environment  The  players  in  this  simulated  batdefield  envirraiment  are  not 
(xily  the  weiqxin  system  operattvs,  but  also  the  ctxmnanders,  staffs,  logisticians,  support 
units,  intelligence  perscMmel,  and  decisitMi  makers  at  all  levels~in  short,  all  the  combat 
combat  support  and  combat-service  support  elonents  assigned  to  die  battle  force  and  its 
support  By  definition,  such  warfighting  skills  are  acquired  and  practiced  in  large-scale 
exercises  and  simulated  at  actual  war.  The  large-scale  exercises  require  actual  maneuvers 
with  a  great  many  pe<o>le  and  systems;  the  simulated  battlefields  require  die  lands  of 
distributed  interactive  simulations  addressed  here. 

The  training  qyplications  of  Distributed  Interactive  Simulation  (DIS),  as  we  have 
used  the  term,  are  intended  neatly  exclusively  for  die  training  and  practice  of  warfighting 
skills.  DIS  is  not  designed  for,  and  rruiy  not  always  be  qipropriate  for,  basic  skills 
training.  For  example,  it  assumes  that  a  pilot  knows  how  to  fly-how  to  control  and 
operate  his  aircrafi-and  is  not  intended  to  develop  or  inqirove  the  pilot's  basic  airwosk  or 
flying  skills.  Accordingly,  fidelity  concerns  for  an  aircraft  simulated  in  aDIS  configuration 
could  be  quite  different  from  those  of  a  simulator  intended  to  provide  airwosk  training. 
Similariy,  as  we  know  fixxn  die  SIMNET  program,  skills  such  as  planning,  coordination, 
and  cornmunication  in  armor  operations  can  be  trained  effectively  in  a  simulator  that  does 
not  kxdt  or  operate  exactly  like  a  real  tank,  h  is  iriqiortant  to  rernember  that  the  mieiufed 
use  cf  the  simulation  is  die  only  acceptable  basis  for  decisions  about  fidelity,  validity, 
realism,  and  all  the  other  terms  that  ^iply  to  a  simulation's  correspondence  widi  reality. 
The  intended  uses  of  DIS  are  almost  always  different  from  those  of  simulators  used  in 
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basic  skills  training,  and  diese  distinctions  must  be  kept  clearly  in  mind  when  evaluating  a 
simulation  for  either  use-DIS  or  basic  skills  training. 

Papers  suggested  for  further  reading  (xi  topics  related  to  QuestitMi  1  include  Alluisi 
(1991),  Thoipe  (1987),  and  Madden  (1988). 

15.  If  fidelity  requirements  are  only  dependent  tm  intended  use,  why  do 
people  worry  so  much  about  negative  training? 

When  people  talk  about  negative  trainings  they  are  probably  referring  to  what  skill 
acquisiticm  theory  calls  negative  tranter.  Negative  transfer  fincnn  simulation  would  mean 
that  something  about  a  task  learned  in  a  simulator  would  actually  intedfere  widi  die  ability  to 
perform  that  task  in  the  real  worid;  that  is,  the  task  would  be  performed  after  the  simulator 
practice  less  well  than  without  such  practice.  Negative  transfer  in  today's  simulaticm  world 
is  almost  ntmexistenL  Simulatorstypically  provide  what  we  caU  positive  or  partial  transfer, 
some  portion  of  the  simulated  practioe  goes  to  ingnove  performance  on  die  real  task.  This 
is  s(»netimes  measured  in  transfer  effectiveness  ratios  (TERs).  A  TER  of  0.8  would  mean 
that  5  hours  in  a  Mmniiitnr  gives  the  same  inqnovement  on  die  job  as  4  hours  on  the  actual 
system;  cases  whoe  die  TER  is  greater  than  unity  are  also  known. 

TERs  are  sometimes  evaluated  on  die  basis  how  much  it  costs  for  one  hour  in  the 
siniulator  versus  one  hour  in  die  real-world  operating  systeno.  A  simulatm  with  a  TER  of 
0.5  is  a  real  bargain  if  the  system  costs  3  or  4  times  as  much  per  hour  to  operate  as  the 
simulator.  In  modem  simulation,  we  would  be  concerned  if  a  TER  was  much  lower  than 
0.3  or  0.4.  Transfer  is  almost  never  zero,  and  negative  values  are  extraordinarily  rare.  To 
get  negative,  as  ccmtrasted  with  partial,  transfer,  the  simulator  would  have  to  teach 
something  that  dramatically  interfered  with  performance  oa  die  real-world  actual  system- 
for  example,  controls  operating  in  reverse,  inconqiatible  procedural  steps,  etc.  Reduced  or 
lower  fidelity  refers  only  to  the  completeness  widi  which  a  system  is  represented.  If  the 
time  needed  for  training  in  a  given  simulator  or  training  device  is  greater  dian  in  the  actual 
equipment,  that  training  equqnnent  is  by  definition  of  reduced  or  lower  fidelity.  This  does 
not  imply  an  inoonect  representation,  a  condition  that  should  never  occur  in  a  properiy 
designed  simulation.  Reduced  fidelity  simulations  do  not  cause  n^ative  transfer. 

Papers  suggested  for  further  reading  on  topics  related  to  Question  IS  include 
Cormier  and  Hagan  (1987),  Hays  and  Singer  (1979),  Rankin  et  aL  (1984),  and  Waag 
(1981). 
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16.  You  mentioned  earlier  the  validity  of  a  simulation  as  another  way  of 
talking  about  fidelity.  Can  you  expand  on  that  idea? 

Previously,  we  distinguished  among  the  terms  fidelity,  validity,  and  realism. 
Although,  for  convenience,  we  deliberately  ignmed  some  of  these  distinctions  in  some 
answers,  the  differences  are  important  for  understanding  current  thinking  about  fidelity 
issues.  We  have  made  the  point  that  fidelity  as  a  term  has  no  useful  meaning  until  we  ask, 
Tidelity  fen  what  purpose?"  Once  we  have  defined  the  intended  use,  we  are  ready  to  talk 
about  the  validity  of  a  simulation.  In  our  earlier  discussion,  we  suggested  that  the  term 
Hdelity  might  usefully  be  reserved  for  descriptions  of  the  degree  of  physical 
correspondence  between  a  simulation  and  the  reality  it  represents,  while  using  the  term 
validity  to  refer  to  the  extent  to  which  die  simulation  achieves  its  purposes.  We  noted  diat 
there  were  at  least  three  kinds  of  i^lications  fen  simularions--training,  acquisition,  and 
analysis.  Each  of  these  would  have  different  goals,  and  the  validity  of  any  one  simulaticm 
used  in  the  different  applicatimis  would  vary  accordingly.  A  simulator  with  high  or  low 
validity  for  one  use  would  not  necessarily  have  the  same  degree  of  validity  for  another  use. 
Focusing  on  the  term  validity  is  (xie  way  of  emphasizing  a  point  that  we  made  previously; 
namely,  that  fidelity  is  not  an  objective  or  a  driver  for  a  simulatitm,  but  rather  it  is  only  a 
way  of  configuring  the  simolatkm  in  order  to  achieve  a  desired  vaM^. 

Validity  as  a  term  shares  a  common  difficulty  with  fidelity-neither  is  easily  or 
readily  quantifiaMe.  In  its  current  usage,  validatkn  is  seen  not  as  an  evoit  or  result  with  an 
associated  number,  but  ladier  as  an  ongoing  process  or  set  of  operations  that  evaluates  the 
conresptHidence  between  simulation  and  teal  world  fiom  the  perspective  of  intended  use. 
That  is  to  say,  a  simulation  is  never  validated^  but  ratiier  it  undergoes  validation.  Thus,  the 
validaticm  process  involves  the  gathering  of  evidence  about  credibility.  This  evidence  can 
be  in  many  forms,  from  simply  verifying  that  the  logic  and  assunqrtions  used  in  the 
simulation  design  are  ‘‘reasonable,”  to  evaluations  of  simolatkm  outconoes  subject  matter 
expats,  to  formal  coDqtarisons  of  outcomes  with  laboratory  findings  or  c^teratiotud  data. 
The  more  we  can  otxain  sudi  evidence  about  a  simulation,  the  more  credible  our  results  and 
the  higfier  its  judged  validity.  Because  simulations  have  assumed  such  an  inqxxtant  role  in 
all  aspects  of  skill  training,  analysis,  and  system  design,  test  and  evaluation,  there  has  been 
ccmsiderable  interest  in  recent  years  in  standardizing  the  defittitions  of  terms  used  to 
describe  validation  operatirms,  and  in  distinguishing  tiiem  fiom  terms  that  describe  other 
kinds  of  sinnilation  evaluations.  Two  such  terms  are  verification  and  accreditation. 
Verification  of  a  simulation  is  amply  the  process  of  determining  tiiat  die  rimulatinn  is 
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pioperiy  implonented;  that  is.  diat  it  meets  design  specificaticxis  and  that  its  equations  and 
algorithms  are  conectly  translated  computer  codes.  Accreditation  is  a  frarmal  decision, 
given  the  weight  of  evidence,  that  the  simulation  is  sufficiently  valid  to  be  acceptable  for  a 
specific  intended  use.  Procedures  for  formal  accteditatitMi  vary  by  Service  and  are  usually 
implemented  by  a  formally  published  instructkm. 

Papers  suggested  for  further  reading  on  topics  related  to  Question  16  include 
Hodges  and  Dewar  (1992),  Jones  et  al.  (1985),  and  Williams  and  Sikora  (1991). 

17.  OK,  that  just  about  wraps  it  up.  Any  last  comments? 

Just  a  few.  Over  the  past  30  years,  simulatitm  has  become  both  an  increasingly 
viable  and  a  progressively  more  necessary  alternative  to  using  actual  equipment  and  field 
exercises  for  traiiting  perstxinel  in  warfighting  skills  and  for  carrying  out  certain  phases  of 
weapon  system  design  and  evaluaticm.  These  trends  are  hi^y  likely  to  ctmtinue  aixl 
probably  accelerate,  given  tiie  steady  irtprovements  in  all  aq;)ects  of  sunulatim  technology. 
A  well-designed  simulation  can  certainly  offer  dramatic  leverage  on  cost-effectiveness 
compared  to  most  other  ways  of  achieving  tiie  same  objectives.  As  projected  drawdowns 
in  equipment  and  personnel  occur,  simulatkm  will  eventually  represent  a  most  attractive  (if 
not  the  only  feasible)  mechanism  for  certain  lands  trf  training  and  system  evaluations,  and 
the  technology  of  distributed  interactive  simulation  wiU  rqnesent  a  noost  attractive  (if  not 
die  only  practical)  avenue  by  vdtich  such  simulations  can  be  carried  out 

When  tperations  tiutt  have  been  anchored  in  the  real  world  are  replaced  by  dx)se 
removed  a  step  further  from  reality,  there  is  always  a  concern  that  somedung  crucial  has 
been  lost  It  is  important  to  understand  diat  what  is  lost  in  moving  to  simulation  can  be 
tninimiTed  by  catefol  attention  in  simulatitm  design  to  rplicating  in  greatest  detail  those 
features  duit  are  most  significant  for  die  intended  ^plication.  For  this  sort  of  tailored 
design  to  take  place,  we  must  be  able  to  see  fidelity  and  validity,  not  as  indivisible,  all-or- 
none  ccmcepts,  but  rather  as  context-specific  terms  with  many  levels  of  gradation. 
Generalities  are  not  us^iil.  We  must  be  thoughtful  and  precise  in  our  evaluaticm  of  a 
simulation,  always  forming  our  questions  in  die  context  of  intended  use.  Over  time,  it  is 
inevitaUe  that  simulations  will  encroach  on  a  host  of  new  application  territories.  The 
decisions  to  be  made  will  probably  relate  less  to  whedier  or  not  simulation  should  be  used, 
but  rather  more  with  how  siiTBilation  can  be  most  successfully  implemented. 
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